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Abstract. 1 The paper deals with the basic integral equation of random field esti- 
mation theory by the criterion of minimum of variance of the error estimate. This inte- 
gral equation is of the first kind. The corresponding integral operator over a bounded 
domain Q in W 1 is weakly singular. This operator is an isomorphism between appropri- 
ate Sobolev spaces. This is proved by a reduction of the integral equation to an elliptic 
boundary value problem in the domain exterior to Q. Extra difficulties arise due to the 
fact that the exterior boundary value problem should be solved in the Sobolev spaces 
of negative order. 



1 Introduction 

For convenience of the reader, all standard notations, such as N+, K, C, the definitions 
of the Fourier transform, of the Sobolev spaces, etc, are placed in the Appendix. 
Let P be a differential operator in M. n of order /j,, 

P :=P(x,D) := a a (x)D a 1 

|a|<At 

where a a (x) G C°° (M n ) . 
The polynomials 

V 0, := aa ( x ) and Po ( x > f ) := aa ( x ) £° 

|a|</i |a|=M 



!Math subject classification: 35S15, 35R30, 45B05, 45P05, 62M09, 62M40; 
key words: integral equations, pseudodifferential operators, random fields estimation, boundary-value 
problems, Fredholm property 
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are called respectively a symbol and a principal symbol of P. 
Suppose that the symbol p(x, £ ) belongs to the class SG < - P ' ' ) (R™) consisting of all 
C°° functions p (x, £) on R™ x R n that for any multiindices a, (3 there exists a constant 
C Q)i g such that 



£>^p(a:,0 <C a)/3 (er^(x)- |Q| (^er, (0:=(l + |e| 2 ) 1/2 ) (1) 

It is known (cf. [13, Prop. 7.2]) that the map P (x, D) : S (R n ) -> 5 (R n ) is contin- 
uous, where 5 (R n ) is the space of smooth rapidly decaying functions (see Appendix). 
Let H s (R™) (s G R) be the usual Sobolev space (see Appendix). It is known that 
P (x, -D) naturally acts on the Sobolev spaces, i.e. the operator P (x, D) is (cf. [13, 
Sec. 7.6]) a bounded operator: /7 s (R n ) -> if*-** (R n ) for all s G R. 

P (x, £>) is called elliptic, if p {x, f ) ^ for any x G R n , £ G R™ \ {0}. 

Let P (x, D) and Q (x, D) be both elliptic differential operators of even orders p 
and v respectively, < p < u, with symbols satisfying (1) (for Q (x,D) we replace p 
and p in (1) respectively by q and v). The case /x > v is a simpler case which leads to 
an elliptic operator perturbed by a compact integral operator in a bounded domain. 

We assume also that P (x, D) and Q (x, D) are invertible operators, i.e. there exist 
the inverse bounded operators P" 1 (x, D) : H s ~^ (R") — > H s (R n ) and (x, D) : 
f/---" (R«) H s (R n ) /or a// s G R. 

Let P := (x, D) P (x, P) . The ellipticity and invertibility of P (x, D) and 
Q (x, D) imply that R is an elliptic invertible pseudodifferential operator of negative 
order fj, - v acting from H s (R™) onto H s+l/ -^ (R n ) (s G R) . 

Since P and Q are elliptic, their orders /i and v are even for n > 2. If n = 2, we 
assume that /i and z/ are even numbers. Therefore, the number a := (u — p) /2 > is 
an integer. 

Let f2 denote a bounded connected open set in R n with a smooth boundary dVl 
(C°°-class surface) and Vt its closure in L 2 (Q), i.e. f2 = U <9f2. The smoothness 
restriction on the domain can be weakened, but we do not go into detail. 

The restriction Rq of the operator R to the domain Q C R n is defined as 

R n :=r n Re n _, (2) 

where is the extension by zero to f2_ := R n \ and is the restriction to f2. 

It is known (cf. [2, Th. 3.11, p. 312]) that the operator Pq defines a continuous 
mapping 

Rn : H s (SI) - P s+ ^ (fi) (s>-l/2), 

where P s (f2) is the spaces of restrictions of elements of H s (R ra ) to with the usual 
infimum norm (see Appendix). 

The pseudodifferential operator P of negative order p — v as well as its restriction 
Rq can be represented as integral operators with kernel P (x, y) : 

Rh = J R (x, y) h (y) dy, R n h = J R(x,y)h (y) dy (x G fi) , 
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where R (x, y) G C°° (R™ xl"\ Diag) , Diag is the diagonal in R n x R n , Moreover, 
R (x, y) has a weak singularity: 

\R (x, y)\ < C \x — y\ a n + fi — u < a < n. 

For n + fi — v < 0, R (x, y) is continuous. 

Let 7 := n + fi — v and r xy := |x — y| — > 0. Then i?(x, y) = 0(r~J) if n is odd or if 
n is even and v < n, and R(x, y) = 0(r~J logr^) if n is even and v > n. 

In [6], the equation 

Rnh = fe H a (Q) , lie # ~ a (3) 

is derived as a necessary condition for the optimal estimate of random fields by the 
criterion of minimum of variance of the error of the estimate. The kernel R(x, y) is a 
known covariance function, and h(x, y) is the distributional kernel of the operator of 
optimal filter. The kernel h(x,y) should be of minimal order of singularity ([6]). In 
[6], the case was considered when P and Q are polynomial functions of a selfadjoint 
elliptic operator defined in the whole space. In [7] and [8], some generalizations of this 
theory are obtained. This paper presents an extension of some results from [7]. 

The purpose of this paper is to prove that, under some natural assumptions, the 
restriction operator R n is an isomorphism of the space Hq 0, onto H a (Q) where 
a = (v — /i)/2>0 and Hq (s G K) denotes the subspace of H s (R™) that consists 
of the elements supported in Q (see Appendix). 

To prove the isomorphism property, we reduce the integral equation (3) to an equiv- 
alent elliptic exterior boundary-value problem. Since we look for a solution u belonging 
to the space H a = H^^^l 2 and the differential operator Q is of order z/, then 
Qu should belong to some Sobolev space of negative order. This means that we need 
results on the solvability of (23) in Sobolev spaces of negative order. Such spaces as well 
as solvability in them of elliptic differential boundary value problems in bounded do- 
mains have been investigated by Ya. Roitberg [9] and later by V. Kozlov, V. Maz'ya, J. 
Rossmann [5] . The case of pseudodifferential boundary value problems has been stud- 
ied in [4]. A. Erkip and E. Schrohe [1] and E. Schrohe [11] have proved the solvability 
of elliptic differential and pseudodifferential boundary value problems for unbounded 
manifolds and in particular for exterior domains. These solvability results have been 
obtained in so-called weighted Sobolev spaces and in particular in the Sobolev spaces 
H s of positive order s. To obtain the isomorphism property, the solvability results 
by A. Erkip and E. Schrohe for exterior domain should be extended to the weighted 
Sobolev spaces of negative order. One can find in Appendix the definition of these 
spaces which is similar to [9] and [5]. 

2 Reduction of the basic integral equation to a 
boundary-value problem 

Theorem 1. The integral equation (3) is equivalent to the following system (4), (5), 
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(6): 



Qu = in Q_ 



< j < a - 1 



(4) 



P/i = QF, he H a (Q.) (5) 
where u G (fi-) is an extension-function for f, i.e. 

Proof. Let /i G # ~ a (ft) be a solution to (3), i.e. ifo/i = / G # a (ft). Let us 
define F := Q~ x Ph. Since h G # ~ a (ft) , then Ph G if" -* 4 (R n ) and F = Q^P/i G 
H -a+v-» ( R «) = _ We have j = RqH = rQ Q-iph = r n F, i.e. F is an extension 

of /. Therefore, F can be represented in the form (6). Further, since F = Q~ l Ph, then 
Ph = QF, i.e. h is a solution to (5). Since h G H a (ft) , then QF = Ph G if^ 0- " • 
It follows, that Qu = in ft_. Since F e H a (R n ) , we get £>> = on <9ft_, < 
j < a — 1. This means that u G i/ a (ft-) is a solution to the boundary value problem 

(4) . Thus, it was proved that any solution to (3) is also a solution to the system (4), 

(5) . 

In the opposite direction, let a pair (u, h) G H a (ft_) x H a (ft) be a solution to the 
system (4), (5), (6). Since Ph = QF, then Rh = Q~ l Ph = F. It follows from (6) that 
Rnh = Rh\ n = F\ n = f, i.e. h is a solution to (3). ■ 

Remark. If /i > 0, the boundary value problem (4) is underdetermined because Q 
is an elliptic operator of order v and needs therefore is/2 boundary conditions, but we 
have only a (a < v/2) conditions in (4)- Therefore, the next step is a transformation 
of the equation (5) into f/,/2 extra boundary conditions to the boundary value problem 
(4)- After some preparations it will be done in Theorem 2. 

Notation. Let A denote a family (A G R, t G Z) of order-reducing pseudodiffer- 

ential operators S' +>A := (£, A) T, where X+ (£, A) := ((1 + |£'| 2 + A 2 ) 1/2 + i£ n )' 

is the symbol. It is known that the operator A maps the space Sq (R™ ) := 
[u G S (R n ) : suppw C R"} onto itself and has the following isomorphism properties 
for s G R: 



: H s (R") : 
■■ H s » (R+) 

Suppose that there exists a real-valued 
differential such that <9ft = {x G R™ : u> (x) - 



- H s - f (R n ) , (7) 

- H*-* (R+) . (8) 

C°° function u; with nowhere vanishing 
= 0} and ft_ = {x G R" : w (x) > 0} . This 
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means that ft_ is a particular case of a SG-compatible manifold with boundary <9ft (cf. 

j 

[1, Sect. 1.2]). Let {J ftj be a cover of lR n by finitely many coordinate charts. Let 

j'=i 

{</?!, ...,y2j} be a partition of unity and {^i, ...,il>j} be a set of cut-off functions such 
that (i) supp(/2j, supp^j C ft^, (ii) </?jVj = fji ( m ) -^^Vj (^O = O ^(rr) - '"' j , and (iv) 

D a ipj (x) = O ((x)- |a| ) . 

Let us define a family of pseudodifferential operators depending on a parameter 
A > 

j 

3=1 

It is known ([3], [11]) that for large enough A, the operator is an isomorphism: 

A* + : H" (W 1 ) ~ H 3 - 1 (W) , seR, 

as well as an isomorphism: 

A* + : H* (ft) ~ H^ 1 (ft) , s G R. (9) 

Lemma 1. Let P(x,D) be an invertible differential operator of order n, i.e. there 
exists the inverse operator P -1 (x, D) which is bounded: H s ~^ (W l ) — > H s (W 1 ) for all 
s G R. Then a solution h to the equation 

P(x,D)h = ge H a ^ (ft) 

belongs to the space H^ a (ft) if and only if g satisfies the following /x/2 boundary con- 
ditions: 

renDiA-^p- 1 (x, D) g = (j = 0, ...,n/2 - 1) . 

Proof. Necessity. Let /i = P" 1 (x, D) g G PT ~ a (ft) be a solution to P (x, D)h = 
g G // _a_/i (ft) . By (9), we have A~ a ~^ /2 h G H^ /2 (ft) . Therefore, rQ^D^'^h = 
(j = 0,...,/i/2-l). 

Sufficiency. Assume that the equalities tqqD^A^ ^ 2 /i = (j = 0, ...,/i/2 — 1) 
hold. Since g G # ~ a_/i (ft) C H'^ (M n ) , we have h = P" 1 (x, D) g G PT a (K n ) . 
Therefore, # := A; a ^ /2 /i G £P /2 (M n ) . Since ran-Dj* = ( j = 0, ...,/i/2 - 1), we 
have * = ^ + + ^_, where ^+ := e n _r n * G P^ /2 (ft) and ^_ := e n r n _^ G H^ /2 (ft_) . 
Since A" /2 : # m/2 (ft) ~ P^ a (ft) , A^ /2 ^+ G P^ a (ft) . Moreover, A+ /2 is a differential 
operator with respect to the variable x n , hence supp\l/_ C ft_ implies suppA+ 2 \I>_ C 
ft_. Since P is a differential operator, 

supp (PA+ /2 ) ^_ C suppA+ /2 ^_ C ft_. 
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On the other hand, we have 

$ := (pa 1 ; 72 ) * = (pa 1 ; 72 ) (#+ + *_) = (pa 1 ; 72 ) ^ + + (pa 1 ; 72 ) 

For any ^ G C °° (ft_) 

= <$,y?> = ((PAf ) * +>¥ ,) + ((pAf ) *_ >¥ ,) = ((PAf ) *_ >¥ ,) 

This means supp(PA 1 ; 72 ) C ft. It follows that supp(PA+ /2 ) ^_ C <9ft. For any 

^_ G C °°(ft_), we have (^A 1 ; 72 )^^ G C 00 ^") and supp(pA 1 ; 72 ) ^_ C dft. 

Therefore, (pA+ /2 ) ^_ = and, moreover, A^ 2 ^_ = (Vtf_ G C °° (ft-)) . Since 

C °° (ft_) is dense in P m/2 (ft_) , one gets A+ /2 ^_ = (v^_ G P m/2 (ft_)) . It fol- 
lows, that 

h = A U J 2 ^ = a; /2 ^ + + A^ 72 ^_ = A+ 7 V + G H a (ft) . 

■ 

Notation. Let P G C°° (ft) n S (ft-)- Assume that P has finite jumps F k of the 
normal derivative of order k (k — 0,1, ...) on <9ft. For x' G <9ft, we will use the following 
notation: 

P (*') := [F] m (x') := Km (P (x' + en) - F (x' -en)), 

F k (x') := [D k n F] dn (x>). 

Let / G C°° (ft) and it G S (ft_) , then we set ~/ k f (x 1 ) := r 9n D^f (x') , ^ k u (x') := 
r dn D^u (x 1 ) . 

Let Sqci denote the Dirac measure supported on <9ft, i.e. a distribution acting as 

(Son, <p):= f V (x) dS, V (x) G C °° (W 1 ) . 
J an 

It is known that for any differential operator Q of order v there exists a represen- 
tation Q = Yl QjD^, where Qj is a tangential differential operator of order v — j (cf 

3=0 

Appendix). We denote by {D a F (x)} the classical derivative at the points where it 
exists. 

Lemma 2. Under the previous notation the following equality holds for the distri- 
bution QF: 

QF = {QF} -iJ2QjJ2 D » (Fj-i-M ■ (10) 

j=0 k=0 

Proof. Let cos (nxj) denote cosine of the angle between the exterior unit normal 
vector n to the boundary 9ft of ft and the 
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We use the known formulas 



/du f — 

-g—dx = J u(x) cos (nxj) da u (x) G C°° (fi) , j — 1, n, 



n an 



J -Q—dx — — J v (x) cos (nxj) da v (x) G j = l,...,n. 



dQ. 



where da is the surface mesure on dQ. Applying these formulas to the products 
u (x) <p (x) and v (x) <p (x) where <p (x) G C °° (K n ) , u (x) G C°° (H) , u (x) G C °° , 
we get 

/du f d^p f 

— — cp (x)dx = — u (x) — — dx + u(x) cp (x) cos (nxj) da j = 1, n, 
dxj J dxj J mm 



/dv f d f 

— — cp (x) dx — — / v (x) — — dx — / v (x) (p (x) cos (nxj) da j = 1, n. 
dxj J dxj J 



3 J 3 

fl- Q- dQ 



By (11), (12), we have 



dF 

dxj 

This means, 

dF (OF 



dx j J \ dx j J J^i 71 dx j 

+ [F] m cos (nx,-) <W <p (x)) , y? (a:) G C °° (M n ) . 



9xj 



|^r| + [^anC 08 ^)^, j = l,...,n. 



It follows, D n F = {D n F} — iF 5on- Further, using the last formula we have D\F = 
D n {D n F} - iD n (F 5 dn ) = {D 2 n F} - iF^qq - iD n (F 5 dn ) and so on. By induction 
one gets: 

j'-i 

DiF = {DiF} -iJ2 D n (Fj-i-kfa) U = 1, 2, ...) . 

v 

Substituting this formula for D J n F into the representation Q = Yl Qj^in we (10)- 
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Denoting by f° and u° the extensions by zero to R n of functions / (x) G C°° (Q) 
and u (a;) G C °° , and using Lemma 2, we obtain the following formulas: 

(Qf)° = Q (/°) - < E ^ E D n ( V) | • M (/ G C°° (n) ) , 

i=i fe=o (13) 



(Q«)° = Q (u°) +^E^'E D n( W" 1 -^) | a n • (« G (n_)) . 

j=i fe=o (14) 

Using these formulas we can define the action of the operator Q upon the elements 
of the spaces $) s ' u (Q) and S^ s,v (£)_) (s G R) (defined in Appendix) as follows (cf. [5, 
Sect. 1.3.2.], [9, Sect. 2.4]): 

(Q {f,±))° ■= Q (f°) ~ * E Qi E D * tyj-k ■ M ((/, G (n)) , 

j=i fc=o (15) 



(Q (u, 0) ) ° := Q (u°) + iJ2 Qi ^ E D * (^--* • M , ( («, 0) e (H_)) . 

j=i fc=o (16) 

It is known ([9]) that Q defined respectively in (15) and (16) is a bounded mapping 

Q : $) 8 > v (Q) -> H s - V (to) and Q : W (Q_) -> (ft_) . 

Moreover, Q is respectively the closure of the mapping / — > Q (x, -D) / (/ G C°° 
or u ^ Q (x,D)u (u G 5 (^-)) between the corresponding spaces. 

Notation. Let W 7 ^ (m = 1, ...,/i/2, £ = a + 1, z/) be the operator acting on 
<9f2 as follows: 



(0) : = z^a-^p- 1 E (0 • M , G C°° (Sfi) . 

<?= a +i j=e (17) 

where 7^ is the restriction to dQ of the (cf. Appendix). 

The mapping W m e is a pseudodifferential operator of order m — fx + v/2 — 1— £ 
acting on dfl. Therefore, for any real s, it is a bounded operator: 

W m£ : H s (dQ) -> # «-"»+f-"/2+i+< (^Q) . 
For G ^ (ft) , we have g := Q (f,f) G H*~ u (Q) , and we set 

w a+m := -Tm-iA^-^P- 1 ^ (m = 1, ...,/i/2) , (18) 
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where the operator 7 m _iA + a ^ 2 p 1 (x, D) is a trace operator of order m — 1 — a — 3/i/2. 

It follows that U? a+m G //M/2-m+l/2 ^ _ 

Theorem 2. T/ie integral equation (3) 

Rnh = fe H a (SI), he H~ a (ft) 
is equivalent to the following boundary value problem: 



Qu = in ft_ 

D > = D U onffi, < j < a - 1 

V 

E W 7 "^ (7*-i«) = w a+m on <9ft, 1 < m < fi/2 

£=a+l 



(19) 



where the functions u, f and h are related by the formulas 

H=P-1QF, FeJP(R»), F:={^£( ( £) 

Proof. Our starting point is Theorem 1. Consider the equation P/i = Q-F, ^ G 
H a (n). Since F G # a (R n ) and Qw = in ft_ by (4), then QF G (M n ) = 

# ~ a ~ M (R n ) . By Lemma 1, a solution h to the equation Ph = QF G P ~ a ~ M (ft) 
belongs to the space Hq 11 (ft) if and only if QF satisfies the following fx/2 boundary 
conditions: 

r da DZ- 1 A- a -' l/2 p- 1 QF = (m = 1, /x/2) . (20) 

Since F = f° + u°, QF = Q (/°) + Q (u°) . Substituting the last expression into (20) 
we have 

Tm-lV-'^Q (ti°) = -Im-lK'^P-'Q (/°) (™ = 1, - ^/2) • 

In view of (15) and (16), one gets: 

i lm ^k- a -» /2 p- 1 ± Q j £ D k n (4>j_ k ■ S 9n ) = 

j=l k=Q 

= 7m _ 1 A; a ^ /2 p- 1 (Q (f, + ^ 7m _ 1 A; a ^ /2 p- 1 ± Qj £ D k n (^-_ fc • M (21) 

j=l fc=0 



Since 



, / G -£P (ft) in ft, 
F - < > uG/P(ft_) mft- andFG// ( R )' 



then 7 i _iM = 7,-_i/ (j = 1, a) . Therefore, = 7 j_iu = 7,-1/ = ^ (j = 1, a) . 

We identify the space H a (ft) with the subspace of fi a,( -^ (ft) of all (/, VO — 
(f,ipi,...,ip v ) such that V'a+i — ••• — — 0- Let (/, ^) belong to this subspace 
and (u, 0) = (u, 0i, <p v ) G fj a,( ^ (ft_) . Then we can rewrite (21) as 

7 m -iA; a ^ /2 p-MQ(/^))° + ^iA; a ^ /2 p- 1 ^g J £ £>r'(^-M = o. 

j=l i=a+l 
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Changing the order of summation 

V j V V 

j=l £= a +l i=a+l 3=1 

we have 



V V 



e=a+i j=i (22) 

where m — 1, ...,/i/2. In view of the notation (17) and (18), the equalities (22) can be 
rewritten in the form of f/,/2 equations 

V 

^2 Wm£ (^) = Wa + m on ^ m = 1 > ^/ 2 - 

€=a+l 

Since 0j = jj-iu for u E S , we rewrite these equalities as 

V 

^2 Wmi (it-iu) = w a+m ondtt, m = l, /i/2. 

*=a+i 

These equalities define /x/2 extra boundary conditions to the boundary- value prob- 
lem 

Qu = in fi_, 

L>> = on 0ft, < j < a - I. 



3 Isomorphism property 

We look for a solution u E i? a (ft-) to the boundary value problem (19). Let us 
consider the following non-homogeneous boundary value problem associated with (19): 

Qu = w in ft_ 

7 0J Bj« := 7o-D£ _1 w = on dft, 1 < j < a 

'j B a+m u:= W me .(ui>-i) =w a+m onffi, 1 < m < /i/2 

where u>, iUj (j = l,...,i//2) are arbitrary elements from the corresponding Sobolev 
spaces (see below Theorem 3 and 4) 

Assumption 1. We assume that the differential operator Q is md-elliptic (cf. [1, 
p. 23]), i.e. its symbol q (x,£) E SG^' ^ (W l ) is invertible for large \x\ + |£| and 
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Note that the mrf-ellipticity differs from the usual ellipticity which says that the prin- 
cipal symbol q (x, ^ for any (x, f ) G W 1 x W 1 \ {0}. 

For the formulation of the Shapiro-Lopatinskii condition we need some notation. 

Notation. Let e > be a sufficiently small number. Denote by U (e-conic neigh- 
borhood) the union of all balls B (x, e (x)) , with the center x G dfl and radius e (x) . 
Let y = (y', y n ) = (y±, y n -i, y n ) be normal coordinates in an e-conic neighborhood U 
of dfl, i.e., dfl may be identified with {y n = 0} , y n is the normal coordinate, and the 
normal derivative D n is D yn near cftl Each differential operator on W n with SG-symbol 
can be written in U as a differential operator with respect to D y i and D Vn within the 
SG-calculus [1, p. 40], i.e. 

3=0 

where Qj (y, D y >) are differential operators with symbols belonging to SG^' ^ (W n ) . Let 

V 

3=0 

be the symbol of Q, where £' and ^ ra are cotangent variables associated with y' and y n . 

Assumption 2. We assume that the operator Q is md-properly elliptic (cf. [1, 
Assumption 1, p. 40]), i.e. for all large \y\ + \i'\ the polynomial q (y , £' ', z) in the complex 
variable z has exactly v/2 zeroes with positive imaginary part t\ (y', £') , t u /2 (y', C) ■ 

We conclude from Assumptions 1 and 2 that the polynomial q (y, z) has no real 
zeroes and it has exactly v/2 zeroes with negative imaginary part for all large \y \ + 

In particular, the Laplacian A in the space W l (n > 2) is elliptic in the usual sense 
but not mrf-elliptic, while the operator I — A is mrf-elliptic as well as md-properly 
elliptic. 

Let 

(n-l 
1 + £6(0 (!/)"%& 
i,3=l 

where g = (g,i 3 ) is a Riemannian metric on dQ. We denote 

v/2 

Consider the operators B m (m = 1, v/2) from (23). Each of them is of the form 

B m = Y,B m 3{y',D yl )Dl 

3=0 

in the normal coordinates y = (y f , y n ) = (y\, y n -i, yn) in an e-conic neighborhood of 
dQ. Here B m] (y f , D y r) is a pseudodifferential operator of order p m —j (p m G N) acting 
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on dfl. Let b m j (y',£') denote the principal symbol of B m j (y',D y i) . Let us note that 
the operators B m from the boundary value problem (23) are operators of this type. 
Scaling down the coefficient operators B m j to order zero, we set 

b m (y f , z) .= b mj o x (y', er pm+J z j 

j=0 

Define polynomials in z 

v/2 

r m (y', z)=^2 r mj (y', £') z 3 

3=0 

as the residues of b m (y' : z) modulo q + (y', £') . 

Assumption 3. ( Shapiro- Lopatinskii condition) The determinant 

det {{r m j (y', £')) m j) ^ bounded and bounded away from zero, i.e. there exist two 

positive costants c and C such that 

0<c<det ((r mj (y',0) m , 3 ) < C 

The following Theorem 3 has been proved by K. Erkip and E. Schrohe [1, Th. 3.1] in 
essentially more general case of the ^G-manifold. The latter includes the exterior of 
bounded domains which is the easiest case of the S'G-manifolds. This case was chosen 
here just for a simplicity of the exposition. 

Theorem 3. (a particular case of [1, Th. 3.1], [11]). If the differential opera- 
tor Q of even order v satisfies Assumptions 1, 2 and 3, i.e. Q is md- elliptic, md- 
properly elliptic and such that the Shapiro- Lopatinskii condition holds for the operator 
( Q, 70-Bi, 70-6^/2); then the mapping 

v/2 

(Q,7o£i, -,70^/2) : H s - H s - V (ft_) x i[H'-^ 2 (dQ) (s > v) 

3=1 

is a Fredholm operator. 

The following Theorem 4 is an extension of Theorem 3 to the case of the Sobolev 
spaces of negative order. 

Theorem 4. Under conditions of Theorem 3, the mapping (Q, 70-61, 70-6^/2) 
can be extended to a Fredholm operator 

v/2 

(Q, 7o 5i, 70^/2) = - K s ~ v x 11 H*-"- 1 ' 2 (dQ) (sgR). 

3=1 

The proof can be obtained just as it was done in [4] for the case of a bounded 
domain. AK hopes to publish the proof separately for a more general case. 
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Assumption 4. Suppose that the Fredholm operator [Q, joBi, 70-6^/2) has the 
trivial kernel and cokernel, i.e. it is an invertible operator. 

For example, if the kernel R(x,y) has the property (Rh,h) > c\\h\\ 2 a for all 

h G Hq" 1 , where c = const > does not depend on h, then the operator in Assumption 
4 is invertible (see [6]). 

Theorem 5. Under conditions of Theorem 3 and in addition under Assumption 
4, the mapping Rq which is defined in Introduction is an isomorphism : (Q) — > 
H a (Q). 

Proof. Les us consider the operator (Q, 70-B1, 70-B172) generated by the bound- 
ary value problem (23). Taking into account that pj =order Bj = j — 1 (j — 1, ...,a) 
and pj =order Bj = j — p + u/2 — 2 (j — a + 1, v/2) , then the operator is as follows: 

(u,(f) ^ (Q (u,(p) ,70-Bi (u,(f) , ...,70-6^/2 (u,0)) = (w,wi, ...,w u / 2 ) 

It maps the spacei3 s '^ to the space 

(Q_) X JJ f^-J'+V2 x JJ H s-j+»-v /2+3/2 (s £ R) . 

J=l j=o+l 

By Theorem 4, the mapping is a Fredholm operator and, in view of Assumption 4, 
it is an isomorphism. Considering the isomorphism for s = a we obtain, in view of 
Theorem 2, that the operator Rq is an isomorphism of the space H^ 0, (£1) onto H a (Q). 
■ 

Example. Let P = I be the identity operator (its order p = 0) and Q = 
I — A, {v — ordQ = 2) . Then, by Theorem 4, the correspondig operator Rq is an 
isomorphism: Hq 1 (Q) — > iJ 1 (Q) . 

Solution of the integral equation (3). Under conditions of Theorem 5 there 
exists a unique solution to the integral equation (3). The question is how to find this 
solution. 

Examples of analytic formulas for the solution to the integral equation (3) can be 
found in [6] . The analytical formulas for the solution can be obtained only for domains 
Q of special shape, for example, when Q is a ball, and for special operators Q and P, 
for example, for operators with constant coefficients. 

We give such a formula for the solution of equation (3) assuming P = I and 
Q = —A + a 2 I . Consider the equation 



J n 4n\x-y 

:p(-a 
4w\x— y\ 



oxp( a\x u /( rj _ x G H C M 3 , a :- 0. (24) 

with kernel R(x,y) := ^J^"^ , P = /, and Q = -A + a 2 L By Theorem 1, one 
obtains the unique solution to equation (24) in Hq 1 ^): 

Hx) = (-A + a 2 )f+(^--^\5 d n (25) 
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where u is the unique solution to the Dirichlet problem in the exterior domain f2_ 
(-A + a 2 )w = in u|an = /|an, u(oo) = 0, (26) 

<9f2 is the boundary of Q, and 5,gn is the delta function with support dfl. 
For any <fi G C^°(lR n ) one has: 

((-A + a 2 )R,(f)) = (R, (-A + a 2 )0) = / /(-A + a 2 )<pdx + / u(-A + a 2 )<pdx 
= J (-A + a 2 )f(pdx + y (-A + a 2 )u(pdx 

Jan \ dn dn J J m \ dn dnj 

where the condition u = f on dfl was used. Thus, we have checked that formula (25) 
gives the (unique in HQ 1 (fl) ) solution to equation (24). 



4 Appendix 

Notation. We denote by K. the set of real numbers, by C the set of complex 
numbers. Let Z := {0, ±1, ±2, ...}, N := {0,1,...}, N+ := {1,2,...}, R n : = 
{x = (xi, x n ) : Xi G R, % = 1, n} . 

Let a be a multi-index, i.e. a := (cti, . . ., a n ), otj G N, \a\ :— a± + . . . + a n , 
i := v^T; D 3 j= i^d/dxj] D a : = D^Df. . .£>«». 

Let C°° (fi) be the space of infinitely differentiable up to the boundary functions 
in fl. Near dfl there is defined A normal vector field n(x) = {n\ (x) , n n (x)) , is 
defined in a neighborhood of the boundary dfl as follows: for x G dfl, n (xq) is the 
unit normal to dfl, pointing into the exterior of fl. We set 

n (x) := n (x ) for x of the form x = Xq + sn (x ) =: ( (x Q , s) 

where Xq G dfl, s G (—5, 5) . Here 5 > is taken so small that the representation of x 
in terms of x G dfl and s G (—5,5) is unique and smooth, i.e., ( is bijective and C°° 
with C°° inverse, from <9fi x (-5, 5) to the set C (dfl x (-5, 5)) C R n . 

We call differential operators tangential when, for x G ( (dQ x (—5,5)), they are 
either of the form 




or they are products of such operators. The derivative along n is denoted <9 n : 
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for x G ( (dQ x (-6J)) . Let D n := r l d n . 

Let fi_ := R n \ fl denote the exterior of the domain Q, rgn, be respectively the 
restriction operators to dVL, Q : rgnf := f\ m , mf := f\ n 

Let S (R™) be the space of rapidly decreasing functions, that is the space of all 
u G C°° (R n ) such that 

sup sup | (l + \x\ 2 ) m D a u (x) | < oo for all m G N. 

\a\<kxeM. n 

Let S be the space of restrictions of the elements u G S (R™) to f2_ (this space 
is equipped with the factor topology). 

Let u G C°° (Q) and v G S (f2_) , then we set ^ k u := r 9n D^u = (D^u)\ m , 
-f k v :=r 9n D*v= (D*v) \ dQ . 

Definition of the Sobolev spaces. Let H s (R n ) (s G R) be the usual Sobolev 
space: 

H s (R n ) := {/ G 5' | T- 1 (1 + \i\ 2 ) sl2 T] G L 2 (R n )j , 

^(i + ieiy 72 ^/ 



L 2 (IR n ) 



where T denotes the Fourier transform / i— > T x ^j{x) = f Rn e iX ^f(x)dx, T 1 its 
inverse and 5' = S 1 (R n ) denote the space of tempered distributions which is dual to 
the space S (R n ) . 

Let H s (Q) and H s (fi_) (0 < s G R) be respectively the spaces of restrictions of 
elements of H s (R n ) to f2 and The norms in the spaces H s (Q) and H 8 (fi_) are 
defined by the relations 

H s (n) := m ^ IMIh s (r») ( s — o) > 

:= ^ HsU/f^R") ( s — o) ' 

where infimum is taken over all elements g G H 8 (R n ) which are equal to / in Q 
respectively in 

By Hq (Q) (s G R) and Hq , we denote the closed subspaces of the space 
H 8 (R n ) which consist of the elements with supports respectively in Vt or in Vt_ i.e. 

H 8 (ft) := {/ eH s (R n ) : supp / C U} C H s (R n ) (s G R) , 

# S := {/ G # s (R n ) : supp / C(l_}cF (R n ) (s G R) . 

We define the spaces 

w . (n):= /*-(n) *>o 



# S s < °> 

# S s < 0. 
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For s ^ k + 1/2 (k = 0, 1, ...,£ — 1) , we define the spaces Sj s,e (ft) and S) s,e (ft_) 
respectively as the sets of all 



= (u, (f)!,.. .,<f>i) and (u,^) = (y, fa, ...,&) 

where u <E H s (ft) , v E H s (ft_) , = (0i, ...,</v) and ip = (fa, ...,ipi) are vectors in 

]T H s ~i +1 l 2 (<9ft) satisfying the condition 
i i 

0i = ^r^lan , V'j = ^"Man for J < min (s, ^) • 
The norms in $j s,e (ft) and S") s,e (ft-) can be defined as 



ll(«.*C 



l u llw s (n) + ll^'llH s -3+i/2(gn) ' 

3=1 



\\( V ^t)\\ls m = \H 2 H s m +^2W\ 2 H .- i+ l/2 {gsl y 

3=0 

Since only the components 4>j an d fa with index j < s can be chosen independently of 
u, we can identify F) s ' £ (ft) and (ft_) with the following spaces. 
For s, si ^ fc + 1/2 (/c = 0, 1, ...,£ — 1) , 

' n s (n), £ = 0, 

ft s (ft), 1 <£<s + l/2, 
&>* (Q) = { H s (ft) x n , < [s + \\ < £, 

j=[s+l/2]+l 

ft s (ft) x ]1 H s -i +1 / 2 (9ft) , s < I 

J'=l 

' n s (n„), £ = 0, 
H s (ft_), 1 < £< s + 1/2, 



f) s/ (ft-) = < 



W (ft_) x fl ^«-i+V2 , o < [s + ±] < £, 

j=[s+l/2]+l 

w (ft_) x n # s ^' +i/2 (9ft) , s < \ 

3=1 



Finally, for s = k + 1/2 (k = 0, 1, 1) , we define the spaces f) s ' e (ft) , 5)^ (ft_) 

by the method of complex interpolation. 

Let us note that fors ^ k + 1/2 (k = 0, 1, ...,£- 1) , the spaces fj 3 ' 1 (ft) , fi s ' e (ft_) 
are completion of C°° (ft) , S (ft-) respectively in the norms 



e-i 



,7o«,-,7<-i«)llJ.,«(n) = ll u llw«(n) +5^ll7i«llH.-i-i/3(an), 

j=0 
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£-1 

||u,7ou,-,7/-iu||fl.,i (n _) = \\ v \\H°(n-) + J2H v \\ 2 Hs-i-i/*(dn) ■ 

3=0 
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